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COMPACT IMAGE STEERING AND 
FOCUSING DEVICE 



BACKOROirND OF thf [NVFMTTnxr 



1. Field of the Invention 

The invention relates to a device for directing light reflected from an 
object in a scene through at least one lens and into a camera. 

2. Backgrou nd of the Invention 

There are several methods known as biometrics for recognizing or 
identifying an individual. These methods include analyzing a signature, obtaining and 
analyzing an image of a fingerprint and imaging and analyzing the retinal vascular 
patterns of a human eye. Recently the art has used the iris of the eye which contains a 
highly detailed pattern that is unique for each individual and stable over many years as 
a non-contact, non-obtrusive biometric. This technique is described in United States 
Patent No. 4,641,349 to Flom et al. and United States Patent No. 5,291,560 to 
Daugman. The systems described in these references require the person being 
identified to hold at least one of their eyes in a fixed position with respect to an imaging 
camera which takes a picture of the iris. While this procedure is satisfactory for some 
applications, it is not satisfactory for quick transactional activities such as using an 
automated teller machine, access control or automated dispensing. 

The iris identification techniques disclosed by Flom and Daugman 
require a clear, well-focused image of the iris portion of the eye. Once that image is 
obtained a comparison of that image with a file image of the iris of the person to be 
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identified can be accomplished quite rapidly. However, prior to the present invention 
there has not been an optical system which could rapidly acquire a sufficiently clear 
image of an iris of the person to be identified unless that person positioned his eye in a 
fixed position relatively close to an imaging camera. There is a need for an optical 
system which will rapidly obtain a clear picture of the iris of a person standing remotely 
from the optical system and in an uncertain position. This system would be particularly 
useful to identify users of automated teller machines as well as individuals seeking 
access to a restricted area or facility or other applications requiring user identification. 

Automated teller machines, often called ATMs, are compact, 
sophisticated electrical devices which have a large number of electrical and 
electromechanical subsystems arranged in a restricted volume. However, there are 
small spaces immediately behind the cover plates of the automated teller machine or 
around the bezel of the display in which a very compact optical system could be placed. 
The location and size of that space may differ among automated teller machines. Yet, 
there are several manufacturers of these machines, two of which are NCR and OKI 
Electric. Each manufacturer offers several models, but the products in each 
manufacturer's ATM product line are quite similar. Although there are several basic 
types of ATMs, the NCR machine and the OKI machine are representative. Any 
optical system for iris identification of ATM users should be suitable for use in the 
various types of ATM machines. The system must also be able to rapidly capture a 
clear image of the iris of the person using the automated teller machine and direct it to a 
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camera. The camera records the image and transmits that image to a digital processor. 
The processor compares the user's image to a file image to complete the identification. 

Many automated teller machines and similar financial transaction 
machines are equipped with video cameras typically positioned above the display panel. 
These video cameras are used for security purposes and are positioned to take a picture 
of the head and shoulders of the person using the machine. These cameras are not 
equipped to rapidly focus on a small region of the user's face. It is not possible for 
these cameras to obtain a sufficiently detailed image of the iris of the user of the 
machine which iris image could be used to identify the user. Therefore, there is a need 
for an optical system which can rapidly acquire and provide a clear, detailed image of 
the iris of the user which image is sufficient for identification of the user based upon 
iris analysis. Preferably, at least one of the cameras used with this optical system could 
be used as a conventional security camera. 

SUMMARY OF THF TNVPMT|r>f>J 
The present compact system can obtain a clear image of a small region 
on an object located from one to three feet from the optical system. The system 
includes a tillable frame which carries a pan/tilt mirror and at least one lens. Light 
reflected from the subject is captured by the mirror and directed through the lens to a 
camera. Two drive motors are mounted on the frame. One drive motor which rotates 
the pan/tilt mirror around a pan axis is provided on one side of a horizontal plane that 
bisects the frame. A second motor is provided on the opposite side of the plane and at 
the opposite end of the frame to move the lens towards and away from the pan/tilt 
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mirror for the purpose of focusing. Other motors for other image acquisition purposes 
could be used. The frame is mounted on a stand in a manner to be rotatable on an axis 
substantially perpendicular to the axis of rotation of the pan/tilt mirror. A motor 
mounted on the stand rotates the frame around a tilt axis. In a preferred embodiment, a 
narrow field of view (NFOV) camera receives the light reflected from the pan/tilt 
mirror through the lens. A second camera and preferably a third camera are provided to 
obtain a wide field of view (WFOV) image of the subject. Images from these cameras 
are processed to determine the coordinates of the specific location of interest, such as 
the head and shoulders and the iris of a person to be identified. Based upon an analysis 
of those images the focus and pan/tilt mirror are adjusted to receive light reflected from 
the iris or other area of interest and direct that reflected light to a narrow field of view 
camera. That camera produces an image of sufficient quality to permit iris 
identification. 

A control system is provided to analyze the images from the wide field 
of view camera and thereby specify the location of a point or area of interest on the 
object or person being identified. A preferred technique for identifying the position of 
the user is stereographic image analysis. Alternatively, non-visible range imaging or 
distance finding devices such as ultrasonic, radar, spread spectrum microwave or 
thermal imaging or sensing could be used. 

The present system can be readily fit into all conventional automated 
teller machines and many other financial transaction machines. Image acquisition and 
identification can generally be accomplished in less than fifteen seconds. 
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Other objects and advantages will become apparent from a description of 
certain present preferred embodiments shown in the drawings. 

BRIEF DESCRIPTION OF THF nr,r mp ? 

Figure 1 is a front view of the face of one type of automated teller 
machine such as is manufactured by NCR. 

Figure 2 is a perspective view of another type of automated teller 
machine manufactured by OKI Electric. 

Figure 3 is a front perspective view of a first present preferred 
embodiment of our steering and focusing device. 

Figure 4 is a perspective view similar to Figure 3 of the first present 
preferred embodiment without the stand. 

Figure 5 is rear perspective view of the embodiment shown in Figures 3 

and 4. 

Figure 6 is a perspective view showing a second preferred embodiment 
of the image sensing and focusing device. 

Figure 7 is a perspective view showing the light path for light reflected 
from an object in the embodiment of Figure 6. 

Figure 8 is a diagram showing a belt drive mechanism that can be used 
for the pan/tilt mirror and focusing lens. 

Figure 9 is a perspective view of a linear drive that can be used to 
position the camera or mirror. 
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Figure 10 is a block diagram showing a preferred axis control 

architecture. 

Figure 1 1 is a block diagram showing a preferred optical control 

architecture. 

Figure 12 is a block diagram showing a present preferred control 
arc ecture for our image steering and focusing device when used for iris 
identification. 

BRIEF DESCRIPTION OF THF PREFERRED FMRODfMFMTS 

Two basic types of automated teller machines are illustrated in Figures 1 
and 2. The dotted lines in those figures indicate the prospective position for our optical 
system and cameras used with that system. 

In Figure 1 there is shown an automated teller machine of the type 
manufactured by NCR. That machine 1 has a console 2 containing a CRT display 4. 
Adjacent to the display are transaction selection buttons 5 in a cover plate 3 which 
surrounds the CRT display 4. A card dip 6 and receipt printer are positioned below the 
cover plate 3. A currency dispenser 8 is positioned adjacent the card dip. It should be 
understood that the console could be configured so that the card dip 6, printer 7 and 
currency dispenser 8 are on the right side or left side of the cover 3. The cabinet for the 
NCR machine is designed to be positioned in a wall of a building or may be configured 
as part of a freestanding ATM. 

The automated teller machine shown in Figure 2 is a stand alone device 
such as is manufactured by OKI Electric. That machine has a cabinet 1 2 which sits on 
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the floor. The cabinet has a vertical face 1 3 in which the card dip 1 6 and a printer 1 7 
are located. The OKI machine 10 also has a counter 14 in which there is a touch type 
display pad 15. A bill dispenser 1 8 and coin dispenser 19 are provided on the counter 
adjacent the upright face 13. 

In the OKI automated teller machine there is a space indicated by dotted 
line box 20 where an optical system and cameras can be placed. This volume is 
approximately 125 mm. wide, 120 mm. deep and 70 mm. high. Our optical system and 
cameras when configured within housing 28 as shown in Figure 6 will fit within this 
space. In the NCR machine shown in Figure 1 volume of similar size is not available in 
any one location. Therefore, as indicated by the dotted lines in Figure 1 we propose to 
place our optical and focusing system at region 24 below the CRT display 4. This 
system would be similar to that shown in Figure 6 except that the camera 60 in Figure 6 
is camera 22 in Figure 1 and only one mirror at location 23 in Figure 1 is used in place 
of two mirrors 58 and 59 in Figure 6. Mirror 23 is a half silvered mirror so illumination 
could be injected and pass out of the front of the machine to illuminate the user. Light 
reflected from the user would enter our device through an opening (not shown) 
provided in the cover plate within region 24. Since we prefer to use infrared light we 
can place an infrared filter over the opening. A user cannot see through this filter, but 
infrared light readily passes. Consequently, the user need not be aware that a camera 
and optical system are present in the machine. A pan/tilt mirror within the device 
would direct light reflecting from the subject being identified to mirror 23. That light 
would be reflected by mirror 23 to camera 22. Of course, any infrared filters supplied 
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with the camera by the manufacturer must be removed. A second and possibly third 
camera can be placed above the CRT display as indicated by dotted block 21 . 

The first present preferred embodiment of our compact image steering 
and focusing device is shown in Figures 3, 4 and 5. In this embodiment, top arm 32 
and bottom arm 33 are connected between right end 3 1 and left end 35 to form a 
generally rectangular frame. A pan/tilt mirror 34 is pivotably attached between arms 32 
and 33 so it can rotate around axis A shown in chainline in Figures 4 and 5. As can be 
most clearly seen in Figure 5, a bracket 46 extends from bottom arm 33 to provide a 
platform for pan motor 47. A gear type mechanism 49 is used to connect the motor to 
the pan/tilt mirror 34. Anti-backlash spur gears or anti-backlash worm and worm gear 
drive trains could be used to transfer motion. We prefer to provide an indicating switch 
48 on the bracket 46. This indicating switch will signal the control electronics when 
the pan/tilt mirror has rotated through a preset position such as 1 5 degrees from a 
position parallel to arms 32 and 33. This indicator switch provides a means to calibrate 
the position of the pan/tilt mirror with respect to a coordinate frame associated with the 
motor. We also provide a lens 36 contained in lens housing 37 and positioned between 
arms 32 and 33. A pair of carrier arms 38 extend from opposite sides of lens housing 
37. The carrier arms fit over lens support rods 39 that extend from the right end 35 of 
the frame. A bracket 44 extends from lower frame arm 33 to carry lens drive motor 45. 
Preferably gear teeth 55 are provided on the carrier arm 48 adjacent the motor 45. The 
gear teeth mesh with motor 45. A worm gear could also be used to transfer motion. 
When the motor turns clockwise the lens will be moved away from the mirror. 
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Counterclockwise motion of the motor advances the lens toward the pan/tilt mirror 34. 
There is a generally horizontal plane P shown in chainline in Figure 5 which passes 
between arms 32 and 33. This plane is equidistant between the two arms. The lens 
drive motor 45 is positioned on one side of plane P whereas the mirror drive motor 47 
is positioned on an opposite side of plane P. The frame can be rotated by motor 52 
connected through drive train 53 about an axis B equidistant between arms 32 and 33 
and running through plane P. A position indicating switch (not shown) can be provided 
to indicate when the frame is at an index or zero reference position or has been rotated a 
selected amount from the index position. By positioning the motors 45 and 47 on 
opposite sides of plane P the frame is counterbalanced along the rotational axis B about 
which the frame is rotated. Pan axis A and tilt axis B shown in Figure 5 are selected so 
that the pan mirror has the least interia and can move the fastest. Movement of the pan 
mirror corresponds to the motion of a user in front of the ATM who should exhibit 
more horizontal motion than vertical motion. We also can provide an optical sensor 5 1 
which reads markings 50 on the lens housing 37 to determine the position of the lens 
relative to the mirror. Stepper motors or DC motors with optical encoders could be 
used as motors 45, 47 and 52. 

Referring to Figure 7, when this device is used, the pan/tilt mirror 34 is 
positioned to receive a reflected light beam indicated by arrow C from the person or 
object to be identified. The light beam is reflected from pan/tilt mirror 34 through lens 
36. Additional mirrors 58 and 59 direct the light beam into camera 60. We may 
optionally provide a magnifying lens 64 behind primary lens 36. We prefer to provide 
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a light source 62 through which a light beam can be directed through beam splitting 
mirror 59 and be reflected off mirror 58 and pan/tilt mirror 34 to a point or region on 
the subject to be identified. Other orientations for the light sources such as around the 
camera body, or slightly off axis to reduce reflections from glasses may be used. The 
light source may emit any selected band of light frequencies including visible light, 
infrared light or both visible light and infrared light. The light source preferably is a 
light emitting diode that emits infrared light. A lens and diffuser (not shown) are 
typically used to guarantee uniform illumination from the LED through the mirror 59 
and to a subject along path C. We have found infrared light to be particularly useful 
because it penetrates eyeglasses and sunglasses more easily than visible light or colored 
light within the visible spectrum. Infrared light is also invisible to the user and 
extremely unobtrusive. Optical filters may be placed in the light path in front of the 
camera to reduce any undesirable ambient light wavelenghts that corrupt the desired 
images. If desired, the LED light source could be strobed using a strobing device 63 
shown in chainline in Figure 4 connected to the LED. Strobing provides the capability 
to freeze motion. 

As indicated by the diagram of Figure 8, the pan/tilt mirror 34 and frame 
could be operated by a cable or metal belt drive mechanism. Motor 70 is connected to a 
drum 72 on p;v mirror 34 by cable or metal belt 71 . Similarly drum 74 could be 
attached to one end 35 of the frame. Motor 76 turns belt 75 to tilt the frame. 

In another embodiment using the mirror drive illustrated in Figure 9, the 
panAilt mirror can be attached with a socket to ball head 80 on the center of an X- 
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shaped frame 82. Linear motors within heads 84 cause the heads to advance and retract 
along rods 86 to tilt the mirror as indicated by the arrows. 

Our device has three degrees of freedom, the pan axis, the tilt axis and 
the focus axis. The pan and tilt axes are used to position the pan/tilt mirror 34 so that 
the correct narrow field is imaged onto the sensing array of camera 60. The focus axis 
allows the lens to be moved so that the imaged object is in focus. 

The design of the optics resolution, magnification focusing and size of 
the imager dictates the distance between the camera and lens and the distance between 
the lens and object to be imaged. The size of the imager is of paramount importance in 
defining the distance from lens to imager and contributes to the depth of focus. Those - 
versed in the art will recognize that camera 60 may be solid state or of vidicon nature 
and that the sensing array size can vary from generic industry sizes of 1/4, 1/3, 1/2, 2/3 
or 1 inch diagonal measurement. In an optical system, the introduction of a mirror in 
an optical path allows the path to be redirected without effecting the optical path length. 
As can be seen in Figure 7, there are three mirrors 34, 58 and 59 in the optical path 
from the object of interest to the camera 60. In the ATM of Figure 1 only two mirrors 
are required 34 and 23. The use of these mirrors allows the optical path to be folded 
back on itself thus reducing the overall required physical length needed to implement 
the optical design. In addition, by using a beam splitting mirror 59 infrared 
illumination from light source 62 can be injected in the optical path so that light is 
projected on the object of interest. This produces on axis illumination which allows 
surface features to be imaged with no shadows which can generate false edges or other 
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artifacts. On axis illumination of the eye produces a shadow free image with good 
surface features. This type of lighting causes the pupil to be white making the iris 
easier to locate. Any shadows produced by other light sources and camera angles are 
minimized or washed out. Other nearly on-axis illumination such as around the camera 
housing may be used. 

Being able to rotate the pan/tilt mirror 34 around the pan axis A and tilt 
axis B allows the camera's field of view to be directed along the pan (left to right) and 
tilt (up and down) axes. The center of the optical axis through the focusing lens 
intersects with the center of the pan/tilt mirror. The use of a directing mirror has the 
advantage that while in our preferred embodiment the mirror's motion in either the pan 
or tilt axis is +/- 17.5 degrees, the camera actually perceives a doubling effect and can 
effectively view +/- 35 degrees in either the pan or tilt axis. This is a major advantage 
as compared to mounting a camera on a pan/tilt stage, since less physical motion is 
required and significantly less weight must be moved. Thus, the present design allows 
for the required field of view but does not require physical motion of the camera and 
attached optics while changing the field of view. 

The focus axis is used to adjust the position of the lens with respect to 
the camera's array so that the field of view that is projected on the camera array is in 
proper focus. In the embodiment that is described, a single lens is used for forming the 
image on the array. It is also possible to have a mechanically coupled set of lenses 
(typically two) so that a telephoto lens is implemented. For this case, the single linear 
motion will control both the distance between lenses and the relative location of the 
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lens closest to the array. This can further be extended to include a motor controlling the 
linear position of each lens with the coupled motion under software control. 
Furthermore, the lens arrangement could be a telecentric design, vanifocal, or another 
arrangement that maintains a constant magnification and focus on the NFOV camera's 
sensing array independent of the location of the image under consideration. 

Our device can be operated manually by using a joystick. In such a 
scenario each axis is controlled by a joystick and an operator in the loop performs the 
adjustments. It is also possible to couple the pan/tilt axis together with a single x-y 
type joystick and associated controller so that the operator could merely move the stick 
in the desired direction and the field of view would follow appropriately. Those versed 
in robotics will recognize that coordinate transformations may be necessary to convert 
the natural coordinate system defined by the pan/tilt axis into the x-y coordinate system 
defined by the joystick. Furthermore, the control between the joystick and pan/tilt 
mechanism may be a simple proportional closed loop position control or evolve toward 
more sophistication such as a PID (proportional integral derivative) or a LQG (linear 
quadratic Gaussian) optimal control scheme. Alternative concepts such as resolved rate 
motion control in which the position of the x-y joystick defines the speed of motion of 
the pan/tilt axes are possible. Regardless, the focus axis would need to remain 
independent since the operator would perform the final judgment in determining if the 
objects in the field of view were properly focused. 

We prefer to provide computer control using two wide field of view 
cameras. The cameras supply images to a computer processing unit which then 
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processes them. Commands are sent from the CPU to the motors to change the location 
of the pan/tilt axes or to adjust focus. This system, shown in Figure 6, contains the 
basic optical platform of the first embodiment plus one or two wide field of view 
(WFOV) fixed focus, fixed location cameras 64 and 66 with associated LED's 68. The 
LED's 68 preferably are infrared illuminators that illuminate a wide field. Camera 60 is 
a narrow field of view (NOFV) camera having a field of view which overlaps a subset 
of the field of view seen by the fixed position/focus WFOV cameras 64 and 66. 

In the context of iris identification, the optical system 30 and cameras 
are required to perform under computer control. The directives for positioning the 
pan/tilt mirror via control of the pan axis, tilt axis and focus axis location will be 
generated based on processing information from the cameras 64 and 66. The WFOV 
cameras could utilize a number of techniques such as stereo, stereo with structured 
light, and depth from focus via structured light to determine both the x-y location and 
distance to the object of interest. For iris identification that location is either the left or 
right eye. Given a scene in the wide field of view, a set of coordinates (x, y, z} with 
respect to the WFOV coordinate system can be determined. These coordinates can then 
be passed to a controller in order to generate the correct axis commands to position the 
pan and tilt and focus axes. 

A calibration procedure must be used to correlate the center of the 
NFOV camera's field of view with pan/tilt and focus axis positions for a series of 
coordinates in 3 dimensional space as defined by the wide field of view. Given a set of 
WFOV coordinates {x,y,z} defining the position of a user's eye somewhere in the 
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working volume in front of the cameras, a transformation or table look up can be used 
to define the coordinates of the pan, tilt and focus {p,t,f} axes that make the center of 
the NFOV camera's field of view coincident with x,y coordinates and in focus on the z 
plane. 

In the simplest case, one may consider that a WFOV image is acquired, 
the data is processed and then passed to the controller. In order to minimize motion 
time and control settling time, all three axes can perform simultaneous motion, that is 
they start and stop simultaneously. 

A second requirement stems from the condition that the object of 
interest, namely the eye, in the WFOV may be moving. There is a requirement that the 
NFOV camera track the trajectory seen by the WFOV. This is so that when motion 
ceases, a quality image may be acquired via the NFOV camera and optics. By tracking 
the eye, the optics directing light to the NFOV camera are aligned so that when it is 
desired to obtain an iris quality image little or no additional motion may be required. 

In this case, the x,y,z coordinates from analysis of the WFOV images are 
sent to the NFOV controller at some uniform sample rate (such as every 100 ms). A 
continuous path algorithm such as described in Robotic Fnpineering An Inte grated 
Approach , by Klafter, Chmielewski and Negin (Prentice Hall, 1989) would be used to 
provide intermediate sets of {p,t,f} set points to the axis so that the axes remain in 
motion during the tracking phase. To define the last end position, either a macro level 
command can be given or the same {p,t,f} can be continually sent at the sample 
periods. 
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It is important to recognize that as the NFOV axes move, the associated 
imager may not have sufficient time to perform the required integration to get a non- 
blurred image. Additionally, depending on the camera used (interlaced or progressive 
scan) there may be field to field displacement or horizontal displacement of the image. 
Thus, it is easily seen why the WFOV camera provides the information necessary for 
directing the NFOV stage. It should be noted, that certain eye tracking algorithms 
(such as those based on specularity or iris configuration or pattern matching) may be 
capable of providing sufficient information (even if the image is slightly blurred due to 
focus or exhibits some blur caused by motion) to provide a reasonable estimate of the 
eye location in the NFOV camera. Thus it is conceptually possible to use the WFOV 
data for coarse movement and the processed NFOV data (during motion) as additional 
information for finer resolution. This fusion of data can provide a better estimate than 
one WFOV camera image alone in positioning the NFOV image to acquire a quality 
iris image. 

To acquire a quality iris image, the NFOV axes must settle to a point 
where the residual motion is less than that which can be detected by the imager. Once 
this occurs, any remaining images must be purged from the imager (typically there is a 
delay between an image integrated and the readout via RSI 70) and the proper 
integration time allowed to acquire a non blurred image. See Robotic F.ngjneerinp An 
I ntegrated Approach for a timing scenario. This can be accomplished in a number of 
ways, the simplest being a time delay which occurs after the cessation of motion until a 
good RS 1 70 image is captured. 
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Since minimizing the settling time of the mechanical stages is of 
importance in obtaining a quality iris image with the minimal delay, the control strategy 
for motion control requires careful consideration. As mentioned in the description of 
Figures 3 and 7, rotary motors with the appropriate transmission components (gear 
drives or rack and pinion) are used as the primary movers. Of course, either stepper 
motors or dc motors (brush or brush-less) may be utilized. Other approaches such as 
incorporating the rotary axis with a frameless motor or using a voice coil or moving 
magnet motor to provide linear motion are also possible. In any case, the control 
strategy requires that the system be stable, be able to track various arbitrary waveforms, 
settle within a well defined time bound, and do all of the above in view of variations in 
temperature which affect the components in the system. 

Figure 10 shows a preferred axis control architecture. Each of the three 
axes (pan, tilt, and focus) is based on this architecture. As depicted, the architecture 
will allow implementation of continuous path algorithms as well as a variety of control 
techniques including but not limited to robust and or optimal control. 

The dotted box depicts a position control loop. In the case of a dc 
motor, this could be a proportional loop consisting of the motor, power amplifier, a 
position transducer, summing junction and the appropriate controller. Since the 
controller is microprocessor based, it is evident that this loop can be implemented in 
software such as a control algorithm and summing junction) with the appropriate 
hardware interfaces for receiving position feedback data and supplying the motor with 
the correct drive signal. This implementation does not preclude other approaches such 
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as a complete digital axis control or the use of analog feedback with the appropriate 
digital or computer interfaces. 

For the case of a stepper motor, which is inherently a position device, 
one may appropriately model the dotted box without the explicit use of position 
feedback. Alternatively, an additional feedback loop may be placed around the stepper 
to gain additional control capability, such as settling time. 

The motor's output is coupled through a transmission (with gear ratio N) 
to the axis being controlled. The axis load is modeled with both linear (inertial and 
viscous damping terms) as well as friction loads, F, and potentially gravitational terms 
(if the load is unbalanced and a torque can be produced). The limit switches or 
alternatively optical sensors are used to provide reference points defining limits of 
motion or the center point of motion for the axis under consideration. 

The supervisory controller accepts motor commands while monitoring 
the motor shaft position and limit switch data ultimately producing the control input, to 
the position control loop. 

Figure 1 1 shows the control architecture for the our optical device. A 
Supervisory Controller accepts macro level commands from the command interpreter 
and generates the proper set points and/or commands for use by the illumination control 
or each axis supervisor. It is envisioned that the intermediate continuous path set points 
for the axis are generated here and then sent to each axis supervisory controller. A 
command interpreter decodes the commands from the image analysis and formats 
responses using positioning information from the optical devices. A real time interrupt 
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produces a known clock signal every n milliseconds. This signal is a requirement for 
the implementation of a sampled data system for the position controller of each axis 
and allows synchronization via the supervisory controller for continuous path motion. 
A diagnostic subsystem performs health check for the control system. 

Besides the choreography of the three axis, the microprocessor controller 
must also provide illumination control. Similar to the commands associated with 
motion control, the controller will accept directives that control the illuminators. 

The block diagram of Figure 12 illustrates how our compact image 
steering and focusing device can be used under computer control for iris identification 
of the user of an automated teller machine. Box 90 represents the embodiment shown 
in Figure 6 and is generally identified as the optical platform. That embodiment 
contains NFOV camera 60 and two WFOV cameras 64 and 65. Images from the 
WFOV are transmitted as analog signals to WFOV subsystem image processor 92. The 
image processor preferably contains two pyramid processors, a memory capable of 
storing at least two frames, one LUT, ALV device, a digitizer which digitizes the 
analog video signal, a Texas Instrument TMS 320 C-3 1 or C-32 processor and a 
serial/parallel processor. The image is processed using the pyramid processors as 
described in United States Patent No. 5,359,574 to van der Wal. The Texas 
Instruments processor computes disparities between images. The WFOV images 
defines a region or point in the field of view of the WFOV cameras where the subject s 
right eye or left eye are located. Using stereo processing techniques on the disparities 
will result in x,y.z coordinates for points on the subject relative to the WFOV cameras. 
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That information is then further processed to define an area of interest such as an eye. 
The coordinates of the area of interest are used to direct the NFOV optical system. 
These position coordinates are transferred from the image processor to a NFOV image 
and iris image processor 94. This unit 94 contains a 486 microprocessor and associated 
memory. In the memory are programs and algorithms for directing the optical platform 
and doing iris identification. Additionally, WFOV video images can be stored as a 
security video record as indicated by the Security Video arrow. Output from the NFOV 
image processor is sent to the NFOV subsystem 96 which contains controllers for the 
motors and the LED's in the optical platform. The NFOV subsystem then activates the 
motors in the optical platform to adjust the pan/tilt mirror and lens to focus the NFOV 
camera and illuminator on that region or point. Images from the NFOV camera are 
directed through the NFOV subsystem and CPU-Digitizer to the NFOV Image 
Processor 94. That video is digitized and used for iris identification. The image 
processor could also use the WFOV images for stereo processing to obtain subject 
position coordinates or for eye tracking. 

The focus axes of the NFOV system may be controlled in an open loop 
fashion. In this case, the Z coordinate from stereo processing defines via table look up 
the focus Axis position so that the elns properly focuses the NFOV camera on the 
object of interest. A closed loop focus method could also be used. In this case, NFOV 
video would be processed by 94 and maybe 92 to obtain a figure of merit defining if the 
Axis was in focus. From the figure of merit the axis could be commended to forward or 
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backward and then a new image acquired. The process would continue in a closed loop 
form until the image is in focus. 

Although we have shown certain present preferred embodiments of our 
compact image steering and focusing device and methods of using that device, it should 
be distinctly understood that our invention is not limited thereto but may be variously 
embodied within the scope of the following claims. 
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We claim: 

1 . A compact image steering and focusing device comprising: 

a. a frame comprised of an end portion having a pair of substantially 
parallel, spaced apart arms extending from one face of the end portion, there being a tilt 
plane passing between and equidistant from the arms; 

b. a primary mirror pivotably attached I etween the arms and able to 
be rotated around a pan axis which is normal to the tilt plane; 

c. a mirror drive motor attached to the frame, connected to the 
primary mirror in a manner to be able to rotate the primary mirror about the pan axis, 
and positioned on one side of the tilt plane; 

d. a primary lens positioned between the arms and aligned with the 

primary mirror; 

e. a lens motor attached to the frame connected to the primary lens in 
a manner to be able to move the lens toward and away from the primary mirror and 
positioned on a side of the tilt plane opposite the side of the tilt plane on which the 
mirror drive motor is positioned; 

f. a stand to which the frame is rotatably attached for rotation about a 
frame axis transverse to the pan axis; and 

g. a frame drive motor mounted on the stand and connected to the 
frame in a manner to rotate the frame about the frame axis. 
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2. The device of claim 1 also comprising a second mirror attached to the 
frame and aligned with the primary lens. 

3. The device of claim 1 wherein the mirror drive motor is a linear drive 

motor. 

4. The drive of claim 1 also comprising a belt drive connected between 
the mirror drive motor and the mirror. 

5. The device of claim 1 also comprising a belt drive connected between 
the frame drive motor and the frame. 

6. The device of claim 1 also comprising a camera aligned with the 
primary lens in a manner so that light passing through the primary lens will go into the 
camera. 

7. The device of claim 1 also comprising at least one secondary mirror 
positioned between the primary lens and the camera. 

8. The device of claim 1 also comprising a second lens positioned 
between the mirror and the primary lens. 

9. The device of claim 1 also comprising a light source positioned so 
that a light beam emitted from the light source will be reflected from the primary 
mirror. 
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10. The device of claim 9 wherein the light source is positioned so that 
the light beam will pass through the primary lens. 

1 1 . The device of claim 9 wherein the light source can emit at least one 
of infrared light, visible light, a select band of frequencies, and both infrared and visible 
light. 

12. The device of claim 9 also comprising a variable aperture lens 
positioned between the light source and the primary mirror. 

13. The device of claim 9 wherein the light source is a strobe light. 

14. The device of claim 1 3 also comprising: 

a. a camera positioned to receive a light beam emitted from the light 
source, reflected by the primary mirror and reflected back from a scene; and 

b. a synchronizer connected to the camera and the light source for 
synchronizing the operation of the camera with the strobing of the light source. 

15. The device of claim 9 also comprising a strobing device connected 
to the light source. 

16. The device of claim 9 wherein the light source is a light emitting 

diode. 
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17. The device of claim 1 also comprising at least one limit switch 
connected to one of the motors. 

1 8. The device of claim 1 also comprising at least one position sensor 
mounted on one of the frame and the stand in a manner to determine positions of at 
least one of the primary mirror, the primary lens and the frame. 

19. The device of claim 1 also comprising a second camera attached to 

the stand. 

20. The device of claim 19 also comprising a third camera attached to 
the stand wherein the second camera and the third camera have overlapping fields of 
view. 

21 . The device of claim 20 also comprising an image processor which 
receives images of a subject in the overlapping fields of view from both the second 
camera and the third camera and processes those images to determine an x, y, z 
coordinate position relative to the second and third cameras for a point on the subject 
forward which point the first camera can be directed. 

22. The device of claim 19 also comprising: 

a. a first camera aligned with the primary lens in a manner so that 
light reflected from the primary mirror and passing through the primary lens will go to 
the first camera; 
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b. an image processor which receives images from the second 
camera and identifies at least one point in the images corresponding to a point on a 
subject being photographed by the second camera; and 

c. a controller connected to the image processor and the mirror drive 
motor which activates the mirror drive motor to position the primary mirror so 
that light reflected from the point on the subject to the primary mirror will be reflected 
by the primary mirror to the first camera. 

23. The device of claim 22 wherein the image processor is programmed 
to compare images from the second camera to determine if the subject is moving, 
calculate a motion path of a moving subject and direct the primary mirror motor to 
compensate for such motion. 

24. The device of claim 1 also comprising: 

a. a narrow field of view camera which receives light reflected 
from a subject to the primary mirror and is reflected from the primary mirror to the 
narrow field of view camera; 

b. a wide field of view camera; and 

c. an image processor which receives images from both cameras 
and identifies at least one point in images received from at least one camera which 
point corresponds to a point of interest on a subject being imaged. 
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25. The device of claim 24 wherein the image processor identifies the at 
least one point in images received from the one of the narrow field of view camera and 
the whole field of view camera. 

26. The device of claim 1 wherein at least one of the mirror drive motor, 
the lens motor, and the frame drive motor is a stepper motor. 

27. The device of claim 26 also comprising a controller connected to the 
stepper motor and a position sensor connected to the controller wherein the position 
sensor provides signals to the controller and the controller supplies the stepper motor 
with corresponding drive signals. 

28. The device of claim 1 wherein at least one of the mirror drive motor, 
the lens motor, and the frame drive motor is a DC motor. 

29. The device of claim 26 also comprising a controller connected to the 
DC motor and a position sensor connected to the controller wherein the position sensor 
provides signals to the controller and the controller supplies the DC motor with 
corresponding drive signals. 

30. The device of claim 9 wherein the light source is positioned around 
the camera body to give nearly on-axis illumination. 
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Fig 8. Fig. 9. 




SUBSTITUTE SHEET (RULE 26) 



) 9743677A1 J_> 



WO 97/43677 



5/7 



PCT/US97/08131 










CD 








O 








so 




o 




Co 




BNSDOCID: <WO 9743677A1 I > 



SUBSTITUTE SHEET (RULE 26) 



WO 97/43677 



PCT/US97/08131 




A 




t 


t 






















1 — J 

1 




1 T 










1 




1 












i 




o 

1 
















CD 




















































Time 




IOP 
Supervisory 
Controller 






fr» 




agnost 
ibsyste 


« -s 










► 


x 

Q Co 



e ho 

o5 



CO 



' CO 



SUBSTITUTE SHEET (RULE 26) 



BNSDOCIO; <WO 9743677A1 I > 



WO 97/43677 



PCIYUS97/08131 




SUBSTITUTE SHEET (RULE 26) 



INTERNATIONAL SEARCH REPORT 



$r^r SSmC ^TlP^ ^ F /SUBJECT MATTER 

IPC 6 G02B17/08 G06K9/00 



According to InternatiocaJ Patent Classification (IPO or to both national class iftcaooo and IPC 



Inte ooaJ Apphcauoo No 

PCT/US 97/08131 



B. FIELDS SEARCHED 



Minimum documentarioo searched (ciassiftcaoon system followed byclasstftcanon symbols) 

IPC 6 G02B G06K G07C A61B 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and. where practical, search terms used) 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category ° 



Citation of document, with indication, where appropriate, of the relevant passages 



US 4 641 349 A (FLOM LEONARD ET AL) 3 

February 1987 

cited In the application 

see column 8, line 1 - column 12, line 17; 

figures 8-12 

EP 0 126 549 A (EYE D DEV II LTD) 28 
November 1984 

see page 5, line 23 - page 11, line 5; 
figure 1 

US 4 287 410 A (CRANE HEWITT D ET AL) 1 
September 1981 



Relevant to claim No. 



see column 3, 1 ine 52 
10; figure 1 



- column 10 , 1 ine 



X | further documents are listed in the continuation of box C. 



1.8-11, 

14,16, 

19-22 



1,2, 

6-11,16 



1-3, 

6-11,16, 

18-23, 

26-29 



|X ] Patent family memben are listed in annex. 



* Special categories of cited documests : 

•A" document defining the general state of the art which is not 

considered to be of paroculAr relevance 
"E* earlier doc um ent but published oo or after the international 
filing date 

L" document which may throw doubts oo priority claimfs) or 
which is coed to establish the publication date of another 
citation or other special reason (as specified) 
"O" document referring oo an ocal disclosure, use. exhibition or 
other means 

P" document published prior to the international filing dale but 
later than the priority date claimed 



T" later document published after the btcrnabooaJ filing date 
or priority date and not in conflict with the application but 
cited to understand the principle or theory underlying the 



Date of the actual completion of the international search 

26 August 1997 



"X* document of particular relevance; the claimed invention 
cannot be considered novel or cannot be considered to 
involve an inventive step when the document is taken alone 

"Y" document of particular relevance: the claimed invention 
cannot be considered to involve an inventive step when the 
document is combined with one or more other such docu- 
ments, such com bin snort being obvious to a person skilled 
in the art. 

"A" document member of the same patent family 



Name and moiling address of the ISA 

European Patent Office, P.B. 5818 Patentlaan 2 
NL - 2280 HV Rijswijk 
Tel. (+31-70) 340-2040. Tx. 31 651 epo a I, 
Fax: (+31-70) 340-3016 



FccmfKT/IS A/210 (lumrtr^HAuy 1992) 



Date of mailing of the international search report 

10/09/1997 



Authorized officer 



THE0PIST0U t P 



page 1 of 2 



BNSDOCID; <WO 9743677A 1 J_> 



INTERNATIONAL SEARCH REPORT 



Inter aaJ Application No 

PCT/US 97/08131 



C.(CononuaooQ) DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 4 



Citanon of document, with indication, where appropriate, of the relevant passages 



Relevant to ctaun No. 



US 4 109 237 A (HILL ROBERT B) 22 August 
1978 

see column 2, line 59 - column 6, line 40- 
figures 1-4 

EP 0 350 957 A (ATR TSUSHIN SYST 
KENKYUSHO) 17 January 1990 



see page 8, line 49 - page 14, line 51; 
figures 8-29 

PATENT ABSTRACTS OF JAPAN 

vol. 096, no. 006, 28 June 1996 

& JP 08 029657 A (CANON INC), 2 February 

1996, 

see abstract 

US 4 070 089 A (GRAFTON DAVID A) 24 
January 1978 

see column 3, line 30 - column 6, line 5; 
figures 1,2 



Fans PCT/tS A/210 (conrijuiooo of aceaod itaeet) (July 1992) 



1,6, 

9-11,16, 
21 



1,2,6, 

9-11,14, 

16, 

19-25,30 



18,26-29 



1,2,4,5, 
7-11,26, 
28 



<WO 9743677A1_I_> 



page 2 of 2 



INTERNATIONAL SEARCH REPORT 

information on pace at family members 



lote. ifijJ Application No 

PCT/US 97/08131 



Patent document 
cited in search report 



US 4641349 A 



US 4109237 A 



EP 0350957 A 



Publication 
date 



Patent family 
member* s> 



03-02-87 



BR 
CA 
DE 
EP 



8605561 
1244552 
3680618 
0215818 
JP 62501889 
WO 8605018 



22-08-78 



17-01-90 



BR 7805230 A 
CA 1093695 A 
DE 2801927 A 
GB 1593001 A 
HK 21685 A 
JP 1365846 C 
JP 53105090 A 
JP 61033579 B 



DE 68926192 0 

DE 68926192 T 

DE 68927275 D 

DE 68927275 T 

EP 0603157 A 

EP 0596868 A 

JP 2138673 A 

JP 7082539 B 

US 5016282 A 

JP 1685975 C 

JP 2224637 A 

JP 3051407 B 



Publication 
date 



22-04-87 
08-11-88 
05-09-91 
01-04-87 
30-07-87 
28-08-86 



EP 0126549 A 


28-11-84 


US 4620318 A 


28-10-86 






AU 570445 B 


17-03-88 






AU 2642884 A 


25-10-84 






CA 1211218 A 


09-09-86 






JP 1002371 B 


17-01-89 






JP 1524496 C 


12-10-89 






JP 59200628 A 


14-11-84 


US 4287410 A 


01-09-81 


NONE 





14- 08-79 
13-01-81 
24-08-78 

15- 07-81 
29-03-85 
26-02-87 
12-09-78 
02-08-86 



15-05-96 
12-09-96 
31-10-96 
06-03-97 
22-06-94 
11-05-94 
28-05-90 
06-09-95 
14-05-91 
11-08-92 
06-09-90 
06-08-91 



US 4070089 A 



24-01-78 



DE 2724181 A 



12-01-78 



Ftm PCI7E A/710 (pum family am, ,;^j y IS92) 
BNSDOCID. tWO 9743677 A 1 I > 



page 1 of 2 



INTERNATIONAL SEARCH REPORT 

Information on patent family members 



Patent document 
cited in search report 



Publication 
date 



Inte. fOnaJ Application No 

PCT/US 97/08131 



Patent family 
metnberts) 



Publication 
date 



US 4070089 A 



FR 2356963 A 
GB 1581275 A 
JP 53003834 A 



27-01-78 
10-12-80 
13-01-78 



i PCT/ISA/210 (pAttnt family 



> (July 1992) 



page 2 of 2 



BNSDOCID: <WO 9743677A1_L> 



